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EXECUTIVE  SUMMARY 


INTRODUCTION 

This  experiment  is  one  of  a  series  of  studies  designed  to 
evaluate  the  ongoing  Cadet  Training  Program  at  the  CAORF 
ship  simulator  located  at  the  U  S.  Merchant  Marine  Academy, 
Kings  Point,  New  York  This  particular  study  represents  the 
first  attempt  to  address  the  issue  of  transfer  of  simulator- 
trained  watchstanding  skills  to  real-world  performance. 

METHODOLOGY 

Two  groups  of  six  first-class  midshipmen  were  evaluated  on 
a  range  sailing  task  Those  in  Group  1  had  participated  in 
Ihe  ten  week  simulator  training  course,  while  those  in  Group 
?  had  no  simulator  experience  The  two  groups  were  taken 
separately  on  the  Academy  training  vessel,  the  T/V  KINGS 
POINTER,  to  Now  Haven,  Connecticut,  where  the  entrance 
channel  is  marked  by  a  range 

The  task  consisted  of  assuming  the  conn  at  the  sea  buoy  and 
sailing  the  entire  first  leg  of  Ihe  entrance  channel  keeping  the 
range  lights  aligned  Each  run  look  approximately  45  minutes. 

PERFORMANCE  MEASURES 

Much  of  the  data  collected  during  this  experiment  was  sub¬ 
jective  Three  performance  measures  were  used:  an  evalua¬ 
tion  form  a  rating  based  on  radar  plots,  and  a  rating  based 
on  the  ship's  course  recorder  The  evaluation  form  assessed 


the  cadet's  performance  in  the  areas  of  watch  relief,  watch- 
standing,  and  range  sailing;  radar  fixes  were  taken  every  60 
seconds  and  a  rating  given,  a  rating  was  assigned  based  on 
data  from  the  course  recorder,  which  indicates  deviations  off 
the  intended  course. 

RESULTS 

Differences  between  groups  on  the  three  performance 
measures  were  tested  using  a  Mann-Whitney  U  Test  Subjects 
in  Group  1,  the  simulator-trained  group,  performed  better  than 
those  in  Group  2.  the  untrained  group,  on  all  three  measures 
These  differences  were  statistically  significant  for  two  of  the 
measures:  the  subjective  evaluation  form  and  the  course 
recorder  rating. 

CONCLUSIONS 

Because  this  study  was  the  first  to  examine  real  world 
behavior,  it  is  recognized  that  there  may  be  certain  drawbacks 
in  the  experimental  design  and  data  collection  techniques 
Despite  its  possible  shortcomings,  this  experiment  did 
demonstrate  the  overwhelmingly  supers  performance  of 
cadets  irained  on  the  CAORF  simulator  over  those  with  no 
previous  simulator  experience.  It  may  be  safely  concluded  that 
the  simulator  program  greatly  enhances  performance  on  a 
real-world  shiphandling  task.  Additional  research  will  expound 
on  this  important  finding. 


1.  INTRODUCTION 

in  the  Spring  of  1981,  the  United  States  Merchant  Marine 
Ar,;ifinmy,  Kings  Point,  New  York  contracted  with  the  Maritime 
Administration's  (MARAD's)  Computer  Aided  Operations 
Research  Facility  (CAORF)  to  develop  a  simulator  training 
program  designed  to  supplement  the  existing  Cadet  Ship¬ 
board  Training  Program  and  Training  Vessel  Program  and 
to  systematically  evaluate  the  effectiveness  of  various  pro¬ 
gram  characteristics.  The  aim  of  the  program  is  to  teach  deck 
cade's  the  duties  and  responsibilities  of  a  licensed  third  mate. 
At  present,  the  midshipmen  spend  a  total  of  approximately 
ten  months  at  sea  on  as  many  as  five  or  six  different  mer¬ 
chant  vessels  Assignment  to  these  ships  is  determined  in 
large  part  by  scheduling  constraints  For  this  reason,  the 
guality  and  quantity  ol  actual  "hands-on”  training  that  the 
midshipmen  receive  is  not  necessarily  consistent.  Simulator 
training  serves  to  ensure  that  certain  critical  aspects  of  the 
bridge  watch  which  may  have  been  given  insufficient  atten¬ 
tion  during  the  sea  year  are  mastered  in  a  simulated  environ¬ 
ment  CAORF s  role  m  this  program  is.  to  develop  training 
objectives  and  simulator  based  training  tools;  to  evaluate  the 
effectiveness  of  the  program,  to  suggest  modifications  to  the 
program  and.  if  implemented,  test  their  effectiveness;  and 
to  systematically  evaluate  issues  related  to  the  training  ef¬ 
fectiveness  This  report  is  one  of  a  series  published  on  this 
topic  It  addresses  the  important  issue  of  transfer  of  simulator 
training  to  the  real  world 

To  dale,  the  performance  of  first  class  midshipmen  (fourth- 
year  cadets)  from  seven  academic  sections  has  been 
evaluated  Three  categories  of  skills  have  been  examined: 
basic  shiphandling,  Rules  of  the  Road,  and  passage  plan¬ 
ning  One  aspect  of  passage  planning,  sailing  a  range  (to  stay 
-  a  harbor  entrance  channel),  was  selected  to  be  used  as 
the  basis  for  evaluating  the  transfer  of  simulator  training  to 
the  real  world 


2  METHODOLOGY 

"ve  be',c.ro"a'ce  of  two  groups  of  midshipmen,  one  with 
s  muiator  training  and  one  without,  was  compared  using  a 
real  world  range  sailing  task  as  the  basis  for  comparison  The 
USMMA  training  vessel,  the  T/V  KINGS  POINTER,  was  used 
to  make  two  trips  to  New  Haven.  Connecticut,  where  the  har¬ 
bor  entrance  channel  is  marked  by  a  range  (see  Appendix 
A)  Subjects  were  twelve  (12)  first  class  midshipmen  All 
volunteered  to  participate  in  the  project.  Those  in  Group  1 
had  had  the  simulator  training  course  |ust  prior  to  their  cruise, 
those  m  Group  2  had  not  had  the  Simulator  course  All  twelve 


had  been  at  sea  for  approximtely  10  months,  but  none  had 
ever  sailed  Into  New  Haven  Harbor. 

As  previously  mentioned,  two  separate  trips  were  made  The 
experiment  was  conducted  two  hours  before  maximum  flood 
current,  at  night,  under  conditions  of  calm  sea  and  clear  sky 
The  current  for  Group  1  varied  from  0.5  knots  to  1.5  knots, 
and  for  Group  2,  from  1 .4  knots  to  2.5  knots.  The  current  was 
always  setting  In  a  westerly  direction. 

The  midshipmen  were  paired  into  watch  teams  standing  four- 
hour  watches.  Once  out  of  the  basin  at  Kings  Point,  the  watch 
teams  conned  the  vessel  for  a  licensed  officer  standing  by 
While  underway  to  and  from  New  Haven,  the  midshipmen 
practiced  navigation,  course  changes,  and  maneuvering  for 
traffic.  Fourth  classmen  (first-year  cadets)  served  as 
helmsmen.  Upon  arrival  at  New  Haven,  the  teams  were  split 
such  that  one  midshipman  conned  the  tug  alone  while  the 
other  went  to  the  chart  room  (isolated  from  the  bridge)  to 
determine  the  strength  of  the  current,  buoy  lighting 
characteristics,  and  his  intended  course  of  action  During  the 
course  of  the  acutal  experiment,  only  one  first  classman  (sub¬ 
ject)  was  on  the  bridge  at  a  time  Ship  speed  was  kept  con 
stant  at  approximately  8  knots.  All  navigation  was  done  visual 
ly;  subjects  were  not  allowed  to  use  the  radar 

Each  experimental  run  took  approximately  45  minutes  At  the 
start  of  each  run,  the  midshipman  maneuvered  the  tug  around 
the  Sea  Buoy  "NH"  and  into  the  Entrance  Channel  Sailing 
as  close  on  the  range  as  possible,  the  midshipman  conned 
the  vessel  to  Buoy  "8"  whereupon  the  captain  assumed  the 
conn  and  turned  the  vessel  around  The  midshipman  then 
conned  the  vessel  outbound  to  the  sea  buoy  where  the  watch 
transfer  took  place  and  the  next  midshipman  repeated  the 
maneuver 

The  range  lights  marked  the  center  of  the  channel  The  Outer 
Channel  Range  Front  Light  and  Rear  Light  were  Flashing 
Green  (F.G  )  characteristic,  visible  on  rangeline  only,  ana 
readily  visible  at  night  Entrance  Channel  was  marked  by 
gated  buoys,  but  Buoys  "2"  and  "3"  were  unlighted  (Buoy 
2  a  red  nun  with  red  reflector  and  Buoy  3  a  black  can  with 
green  reflector)  The  experimenters  timed  the  runs  to  avoid 
outbound  traffic  in  the  channel,  several  runs  were  delayed 
for  this  reason 

3.  PERFORMANCE  MEASURES 

The  evaluation  of  the  midshipmen  s  perlnrmanr  o  was  large 
ly  subjective  To  reduce  variability  and  make  trie  -abny  pr. 
cedure  as  consistent  as  possible  two  steps  were  taken  'nst 
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trie  r.ame  evaluators  were  used  for  both  groups  of  mid¬ 
shipmen,  second,  three  separate  methods  of  evaluating  per- 
lorrnanr.e  were  used  for  all  midshipmen. 

One  evaluator  was  an  Academy  instructor  holding  the  license 
Master  of  Freight  and  Towing  Vessels  not  over  1000  Gross 
Tons  upon  Oceans;  the  other  was  a  member  of  the  CAORF 
staff  and  a  licensed  third  mate. 

3.1  EVALUATION  FORM 

An  evaluation  form  (Appendix  B)  was  used  to  assess  the 
cadets'  performance  in  three  areas:  the  watch  relief,  the 
«vch  tself  and  sailing  on  the  range.  This  form  consisted 
'j‘  /aoous  /es/no"  questions  as  well  as  subjective  rating 
scales 

3.2  RADAR  PLOTS 

Radar  plots  for  each  subject’s  run  were  generated.  Radar 
fixes  from  the  same  object  were  plotted  every  minute  and 
a  rating  was  then  assigned  to  the  overall  run. 

3.3  COURSE  RECORDINGS 

The  ship  s  course  recorder  was  also  used  to  assess  perfor¬ 
mance  The  number  of  deviations  off  course  was  examined, 
and  a  rating  was  again  assigned  to  each  run. 

4.  RESULTS 

All  scores  were  recorded  on  the  results  sheet  (Appendix  C) 
and  converted  to  percentages.  An  overall  score  for  each  mid¬ 
shipman  was  generated  by  computing  a  mean  score  from 
the  three  separate  performance  measures.  Total  group 
means  were  then  computed  and  compared. 

4,1  SUBJECTIVE  EVALUATION  FORM 

Tne  simulator-trained  group  (Group  1)  scored  approximate¬ 
ly  twice  as  high  as  the  untrained  group  (Group  2)  on  the  Sub¬ 
jective  Evaluation  Group  1  also  appeared  to  be  better 
prepared  than  Group  2  in  the  three  areas  of  watch  relief, 
watchstanding,  and  trackkeeping.  Individual  percentage 
scores  and  group  means  are  presented  below: 


Group  1 

Group  2 

Individual 

74  4 

25  6 

Scores 

60  5 

41.7 

73  7 

396 

860 

40.6 

76.3 

18.7 

79.1 

58.1 

Group  Mean 

75.0% 

37.4% 

A  Mann-Whitney  U  Test  was  performed  on  these  scores  to 
ascertain  whether  the  differences  between  the  two  groups 
were  statistically  significant  Results  yielded  a  U  =  0.  which 
is  significant  at  p  <-  0  001 

4.2  RADAR  PLOTS 

Examination  of  the  radar  plots  revealed  that  the  simulator- 
trained  group  again  scored  higher  than  the  untrained  group; 
that  is,  they  demonstrated  a  greater  ability  to  keep  the  vessel 
in  the  channel.  Although  some  of  the  subjects  in  Group  1  were 
not  able  to  stay  on  the  range,  subjects  in  Group  2  experienced 
considerably  more  difficulty  staying  in  the  channel.  Two  runs 
of  Group  2  had  to  be  terminated  early  because  the  mid 
shipmen  were  unable  to  guide  the  vessel  into  the  channel 
at  all.  The  radar  plots  are  presented  in  Appendix  D 

It  should  be  noted  that  the  difference  in  group  means  would 
have  been  much  greater  (36  points  versus  25  points)  had  it 
not  been  for  one  particular  subject  in  Group  i  who  scored 
considerably  lower  than  the  rest  of  the  group  Individual 
scores  and  group  means  appear  below 


Group  1 

Group  2 

Individual 

60 

0 

Scores 

10 

60 

60 

40 

80 

60 

100 

0 

80 

80 

Group  Mean 

65  0% 

40.0% 

The  difference  between  Groups  1  and  2  (including  the  low 
scoring  subject  in  Group  1)  was  not  statistically  significant 
using  a  Mann-Whitney  U  Test. 

4.3  COURSE  RECORDER 

On  this  third  performance  measure.  Group  1  again  scored 
much  higher  than  Group  2.  The  simulator-trained  group,  on 
the  whole,  steered  much  straighter  courses  with  fewer  course 
changes  than  Group  2,  the  untrained  group  The  course 
recorder  results  are  shown  in  Appendix  E  Again,  because 
of  the  poor  performance  of  one  individual  in  Group  1 .  the  dif 
ference  between  groups  was  reduced  These  scores  appear 
below: 


Group  1 

Group  2 

Individual 

100 

0 

Scores 

10 

20 

60 

20 

100 

60 

60 

0 

60 

40 

Group  Mean 

65.0% 

26.7% 
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This  difference  between  the  two  groups  was  statistically 
significant  at  p  •'  0.06.  using  a  Mann-Whitney  U  Test. 

4  4  TOTAL  GROUP  MEANS 

The  total  mean  scores  for  each  group  reflect  the  superior  per¬ 
formance  of  Group  1  The  total  mean  scores  were. 

Group  1  68  3% 

Group  2  34  7% 

All  aspects  of  the  scoring  reflect  this  trend.  Individual  and 
total  group  score  sheets  may  be  found  in  Appendix  F. 

5.  CONCLUSIONS 

From  me  results  of  this  experiment,  it  may  be  inferred  that 
the  simulator  program  enhances  the  midshipmen’s  perform¬ 
ance  level  of  the  duties  of  a  third  mate  in  the  real  world  The 
better  real  world  performance  of  the  simulator-trained  group 
was  evident  in  all  five  performance  measures.  Of  the  four 
measures  which  were  sub)ected  to  statistical  testing,  three 
demonstrated  statistically  significant  differences  between  the 
groups  in  the  hypothesized  direction 

This  study  serves  to  enhance  confidence  in  the  transferability 
of  CAORF  simulator  training  to  the  real  world  It  is  strongly 
recommended  that  the  existing  simulator  training  exercises 
continue  to  be  used  as  a  supplement  to  the  current  academic 
program 

6.  DISCUSSION 

While  this  study  demonstrated  quite  dramatically  that 
simulator-trained  midshipmen  perform  better  on  a  real-world 
range  sailing  task  than  non-trained  midshipmen,  it  must  be 
noted  that  this  experiment  did  contain  certain  problems  which 
ma/  have  affected  the  results. 


Firstly,  the  two  groups  of  subjects  (trained  and  non-trained) 
were  evaluated  on  two  separate  trips  on  the  training  vessel, 
thereby  introducing  the  confounding  effects  of  differing  en¬ 
vironmental  conditions.  The  current  was  somewhat  stronger 
for  Group  2,  the  untrained  group,  which  may  have  affected 
the  subjects'  ability  to  hold  the  vessel  steady  on  the  range 
A  more  desirable  method  of  evaluating  the  two  experimen¬ 
tal  groups  of  midshipmen  would  have  been  to  split  up  the 
groups  and  test  three  of  each  on  the  two  trips.  With  this 
method,  any  variability  in  environmental  conditions  would 
have  been  experienced  equally  by  subjects  in  both  groups 

Secondly,  the  starting  positions  of  the  vessel  for  the  two 
groups  of  subjects  were  different.  Group  i  was  started  in  the 
general  vicinity  of  the  mouth  of  the  channel,  while  Group  2 
was  started  somewhere  near  the  Sea  Buoy  "NH  "  The  dif¬ 
ferences  in  initial  position  and  heading  between  the  two 
groups  may  have  given  the  experienced  group  an  advantage 
over  the  inexperienced  group  These  two  factors  should  have 
been  under  greater  control  to  ensure  uniform  treatment  of 
all  test  subjects 

Finally,  there  may  have  been  a  deleterious  effect  of  helmsman 
on  all  subjects  Only  helm  orders,  such  as  "20°  right,"  were 
given;  helmsmen  were  not  asked  to  steady  on  a  course 
Despite  this,  however,  many  helmsmen  were  so  inexperi¬ 
enced  that  they  had  difficulty  following  these  simple  rudder 
orders.  While  it  is  desirable  to  allow  underclass  midshipmen 
to  participate  in  training  exercises  for  their  own  training,  it 
may  have  affected  the  experimental  results  to  permit  inex¬ 
perienced  helmsmen  in  this  experiment  Several  different 
helmsmen  were  used  each  night  with  little  experimental  con¬ 
trol  over  levels  of  ability  and  experience. 

The  authors  wish  to  stress  that  this  study  was  a  preliminary 
evaluation.  A  pioneer  experiment,  by  definition,  is  exploratory 
and  can  be  expected  to  be  improved  upon.  Despite  some 
drawbacks  in  its  design,  however,  this  study  did  reveal  some 
very  profound  results.  Future  research  in  this  area  will  be  con¬ 
ducted  in  a  similar  manner;  however,  efforts  will  be  made  to 
eliminate  experimental  confounds  and  develop  new  and  more 
objective  methods  of  data  collection. 


CADET  TRAINING/RETENTION 
New  Haven  Evaluation  Form 


Cadet _ Evaluator _ 

Time _ 

Weather _ 

Sea  State _ 

Current _ 

Scenario  —  Open  Sound _ New  Haven  Entrance _ 

Please  answer  each  question  to  the  best  of  your  ability  using  the  knowledge  and  experiences  you  have  gamed 
from  your  time  at  sea.  The  evaluation  questions  which  are  your  subjective  opinions  should  be  marked  on 
a  fair  scale  which  you  have  developed. 

On  the  New  Haven  Entrance  please  use  the  chartlet  to  plot  the  T/V  Kings  Pointer’s  position  on  a  frequent 
basis.  This  chartlet  will  be  used  to  measure  the  cadet's  trackkeepting  ability.  Use  the  radar  or  any  other 
means  to  fix  your  position. 
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I  RELIEVING  THE  WATCH 
A  Determine  Position: 


1  Asks  lor,  or  is  given,  position  on  chart. 

2  Plots  own  position 

B  Requests  Traffic  Information: 

1  Asks  to  be  shown  traffic: 

a  on  radar 
b  visually 

2  Asks  past  action  of  traffic 

3.  Asks  if  there  have  been  any  communications. 

4  Asks  present  CPA’s  of  traffic  ships. 

C  Ownship  Information: 

1  Requests  information  on. 
a  course  steered 
b  course  made  good 
c  engine  speed 
d.  speed  made  good 

e  other  _ 

D  Navigation  Aids: 

1  Requests  location  of  pertinent  aids: 
a  on  radar 
b  visually 

E  Overall  Opinion  of  the  Watch  Relief: 

1  Please  check  the  appropriate  box  indicating  your  subjective  opinion  as  to  the 
cadet's  performance  on  relieving  the  watch 

12  3  4  5 


poor  —  - - »  excellent 

2  Any  comments: 


II  WATCHSTANDING7TRACKKEEPING 

1  Indicate  your  subjective  opmon  as  to  how  the  cadet  treated  the  following  topics: 

1  2  3  4  5 

a  traffic  T~ 


ti  change  in  weather 


1  2  3  4  5 


1  2  3  4  5 


c  change  in  current 


very  well 


2  Please  rate  the  cadet's  navigation  ability  (the  accuracy  of  the  fixes): 
1  2  3  4  5 


poor  * - *  excellent 

3  In  general,  rate  how  frequently  the  cadet  fixed  his  postion: 

1  2  3  4  5 


infrequently 


very  infrequently 


4  In  general,  rate  the  cadet's  ability  to  stay  on  the  range: 

1  2  3  4  5 


poor  - - — - *  excellent 

5  In  general,  rate  the  number  of  helm  orders  given  by  the  cadet  to  stay  in  the  channel  or 
on  the  range 

5  4  3  2  1 


few  * — 


overabundant 


6  Rate  the  overall  ability  of  the  cadet  regarding  his  watchstanding  capabilities.  Please 
include  the  cadet’s  level  of  confidence  as  well  as  his  scores  on  the  above  items. 

1  2  3  4  5 


excellent 


7  Any  comments 
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INSTRUCTIONS  FOR  SCORING  THE  RESULTS 


1.  New  Haven  Evaluation  Form 

The  evaluation  form  is  scord  by  either  yes/no  or  on  a  scale. 
The  yes/no  questions  are  1  point  for  a  yes  and  0  points  for 
a  ro  The  scaled  questions  are  given  the  value  appearing 
aoove  the  checked  box 

If  any  question  is  deemed  N/A,  then  the  question  is  completely 
omitted  from  the  scoring  for  that  cadet.  The  highest  possi¬ 
ble  score  for  the  evaluation  form  (line  IB)  is  derived  by  adding 
up  the  highest  possible  score  for  each  question  that  was  not 
deemed  N/A. 

The  highest  possible  score  and  the  total  score  (addition  of 
all  questions  scored)  should  then  be  placed  on  the  tally  sheet 
on  lines  1A  and  IB  respectively  The  percentage  of  these  two 
scores  should  be  entered  on  line  1C. 

2.  Physical  Measurements 

The  physical  measurements  are  broken  into  two  parts.  The 
first  part  is  for  scoring  the  radar  fixes.  This  is  a  subjective 
rating  on  a  scale  of  1  to  5  with  regard  to  the  fixes  obtained 
during  the  range  maneuvers.  Five  is  the  highest  score  ob¬ 
tainable.  The  percentage  of  the  actual  score  over  the  max¬ 
imum  score  of  five  should  be  recorded  on  line  2B. 


The  second  physical  measurment  deals  with  the  course 
recorder.  The  evaluator  should  examine  the  course  recorder 
and  assign  a  subjective  rating  to  the  results  (line  2C).  The 
fewer  deviations  from  the  course  the  higher  the  score  with 
five  the  maximum  score.  The  percentage  of  line  2C  over  five 
should  be  entered  on  line  2D. 


3.  Total  Score 

The  average  percentage  correct  will  be  used  for  the  "in¬ 
dividual  average"  score.  This  provides  an  indication  as  to 
how  far  the  cadet  was  from  the  total  perfect  score 

To  accomplish  the  “total  score”  add  lines  1C.  2B  and  2D 
together  and  divide  by  3.  Enter  this  value  in  the  box  for 
number  3. 


4.  Total  Group  Score 

The  scores  from  line  3  for  each  of  the  cadets  in  the  same 
group  should  be  entered.  The  total  score  should  then  be  divid¬ 
ed  by  the  number  of  cadets  in  the  simulator  group.  The  scores 
from  each  group  will  then  be  used  to  compare  performance 


CADET  TRAINING/RESEARCH  PRACTICAL 
EXERCISES  EVALUATION  FORM 


CADET  _ _ 

SIMULATOR  GROUP  Experience  or  Inexperienced 

E/a  ,a’ors  -  Visual 
Radar 

1  Evaluation  form 

A  Highest  Possible  Score 
B  Total  Score 
C  Percentage  B/A 

2  Physical  Measurements 

A  Radar  Fixes  (Scale  1  to  5): 

B  Percentage  A/5: 

(1  is  Poor,  5  is  Excellent) 

Comments: 

C  Helm  Orders  — 

Course  Recorder 

(Scale  t  to  5) 

D  Percentage  C/5: 

(1  is  Overabundant;  5  is  Few) 

Comments: 

3  Individual  Average  Score 

(1C  +  2B  +  2D)/3: 


13 


4  Total  Group  Score 


A  Simulator  Experienced  Group 

Cadet 

1 

2 

3 

4 

5 

6 

Total 

Avg  Score 


B  Simulator  Inexperienced  Group 

Cadet  Individual  Average  Score  (Line  3  Individual  Forms) 

1 

2 

3 

4 

5 


l  j  Li  3 ;  1 1 


Course 


:r-r*r» 


3 


COURSE  RECORDER  INFORMATION  FOR  CADET  TRIP  ON 
T/V  KINGS  POINTER 


SIMULATOR  EXPERIENCED  GROUP 


COURSE  RECORDER  —  GROUP  1 


COURSE  RECORDER  INFORMATION  FOR  CADET  TRIP  ON 
T/V  KINGS  POINTER 


NON-SIMULATOR  EXPERIENCED  GROUP 


COURSE  RECORDER  -  GROUP  2 


GROUP  1  —  INDIVIDUAL  RESULT  SHEETS 


CADET  TRAINING/RESEARCH  PRACTICAL 
EXERCISES  EVALUATION  FORM 


CADET 

SIMULATOR  GROUP: 


SUBJECT  1  _ 

Experienced  1  or  Inexperienced 


Evaluators  —  Visual:  CMDR.  MEURN 
Radar:  W.  MILLER 


1  Evaluation  form 

A  Highest  Possible  Score: 

B.  Total  Score. 

C  Percentage  B/A 

2  Physical  Measurements 

A  Radar  Fixes  (Scale  1  to  5): 

B  Percentage  A/5: 

(1  is  Poor;  5  is  Excellent) 
Comments: 

C  Helm  Orders  — 

Course  Recorder 
(Scale  1  to  5) 

D  Percentage  C/5 

(1  is  Overabundant,  5  is  Few) 
Comments 

3  Individual  Average  Score 

(1C  +  2B  +  2D)/3: 


43 


32 


74.4% 


3 


60% 


_ 5 

100% 


78.1% 


37 


CADET  TRAINING/RESEARCH  PRACTICAL 
EXERCISES  EVALUATION  FORM 


r,A DET  SUBJECT  2  _ 

SIMULATOR  GROUP  Experienced]  or  Inexperienced 
Evaluator?  —  Visual  CMDR  MEURN 
Radar  W  MILLER 

1  Evaluation  form 

A.  Highest  Possible  Score: 

B  Total  Score 
C  Percentage  B/A 

2  Physical  Measurements 

A  Radar  Fixes  (Scale  1  to  5) 

B  Percentage  A/5: 

(1  is  Poor,  5  is  Excellent) 

Comments: 

C  Helm  Orders  — 

Course  Recorder 
(Scale  1  to  5) 

D  Percentage  C/5 

(1  is  Overabundant;  5  is  Few) 

Comments 


3  Individual  Average  Score 


; 

» 

► 

- 

w 

L 

u 

! 


CADET  TRAINING/RESEARCH  PRACTICAL 
EXERCISES  EVALUATION  FORM 


CADET 


SUBJECT  3 


SIMULATOR  GROUP:  I  Experienced!  or  Inexperienced 


Evaluators  —  Visual:  CMDR.  MEURN 


Radar:  W.  MILLER 


1.  Evaluation  form 

A.  Highest  Possible  Score: 

B  Total  Score: 

C  Percentage  B/A 
2  Physical  Measurements 

A  Radar  Fixes  (Scale  1  to  5): 

B  Percentage  A/5: 

(1  is  Poor;  5  is  Excellent) 
Comments: 

C.  Helm  Orders  — 

Course  Recorder 
(Scale  1  to  5). 

D.  Percentage  C/5: 

(1  is  Overabundant;  5  is  Few) 
Comments: 


38 


28 


73.7% 


3 


60% 


3 


60% 


3  Individual  Average  Score 


CADET  TRAINING/RESEARCH  PRACTICAL 
EXERCISES  EVALUATION  FORM 


CADET  SUBJECT  4 _ 

SIMULATOR  GROUP  1  Experienced!  or  Inexperienced 
Evaluators  —  Visual  CMDR.  MEURN 
Radar.  W.  MILLER 

1 .  Evaluation  form 

A.  Highest  Possible  Score: 

B  Total  Score: 

C  Percentage  B/A 
if  Physical  Measurements 

A  Radar  Fixes  (Scale  1  to  5): 

B  Percentage  A/5: 

(1  is  Poor;  5  is  Excellent) 

Comments: 

C.  Helm  Orders  — 

Course  Recorder 
(Scale  1  to  5): 

D  Percentage  C/5: 

(1  is  Overabundant;  5  is  Few) 

Comments: 

3  Individual  Average  Score 


‘JIa'I 


CADET  TRAINING/RESEARCH  PRACTICAL 
EXERCISES  EVALUATION  FORM 


CADET 


SUBJECT  5 


SIMULATOR  GROUP  1  Experienced  |  or  Inexperienced 


Evaluators  —  Visual:  CMDR  MEURN 


Radar  W  MILLER 


1.  Evaluation  form 


A  Highest  Possible  Score: 


B  Total  Score: 


C  Percentage  B/A 
2  Physical  Measurements 


A  Radar  Fixes  (Scale  1  to  5): 


B  Percentage  A/5: 


(1  is  Poor;  5  is  Excellent) 


Comments: 


C  Helm  Orders  — 


Course  Recorder 


(Scale  1  to  5): 


D  Percentage  C/5: 


(1  is  Overabundant;  5  is  Few) 


Comments 


3.  Individual  Average  Score 


76.3% 


(1C  +  2B  +  2D)/3: 


CADET  TRAINING/RESEARCH  PRACTICAL 
EXERCISES  EVALUATION  FORM 


CADET 

SIMULATOR  GROUP: 


SUBJECT  6 


|  Experienced 


or  Inexperienced 


Evaluators  —  Visual:  CMDR.  MEURN 


Radar:  W.  MILLER 


1.  Evaluation  form 

A  Highest  Possible  Score. 

B  Total  Score: 

C  Percentage  B/A 

2.  Physical  Measurements 

A  Radar  Fixes  (Scale  1  to  5): 

B  Percentage  A/5: 

(1  is  Poor;  5  is  Excellent) 
Comments: 

C  Helm  Orders  — 

Course  Recorder 
(Scale  1  to  5): 

D  Percentage  C/5: 

(1  is  Overabundant;  5  is  Few) 
Comments: 


79 


80% 


61 


3  Individual  Average  Score 


CADET  TRAINING/RESEARCH  PRACTICAL 
EXERCISES  EVALUATION  FORM 


CADET 


SUBJECT  1 


SIMULATOR  GROUP:  Experienced  or  |  Inexperienced 


Evaluators  —  Visual:  CMDR.  MEURN 


Radar.  W.  MILLER 


1 .  Evaluation  form 


A  Highest  Possible  Score: 


B  Total  Score: 


C  Percentage  B/A 
2  Physical  Measurements 

A  Radar  Fixes  (Scale  1  to  5): 
B  Percentage  A/5: 


(1  is  Poor;  5  is  Excellent) 


Comments: 


C.  Helm  Orders  — 


Course  Recorder 


(Scale  1  to  5): 


D  Percentage  C/5 

(1  is  Overabundant,  5  is  Few) 


Comments 


3  Individual  Average  Score 


(1C  +  2B  +  2D)/3: 


25.6% 


ABORTED  RUN  CADET  LOST 


ALL  OVER  THE  PLACE 


A  m- 


CADET  TRAINING/RESEARCH  PRACTICAL 
EXERCISES  EVALUATION  FORM 


I 


CADET 


SUBJECT  2 


SIMULATOR  GROUP:  Experienced  or  |  Inexperienced  1 
Evaluators  —  Visual  CMDR.  MEURN 
Radar  W.  MILLER 


1.  Evaluation  form 

A  Highest  Possible  Score: 

B  Total  Score: 

C  Percentage  B/A 
2  Physical  Measurements 

A  Radar  Fixes  (Scale  1  to  5): 

B.  Percentage  A/5: 

(1  is  Poor;  5  is  Excellent) 
Comments: 

C  Helm  Orders  — 

Course  Recorder 
(Scale  1  to  5): 

D  Percentage  C/5: 

(1  Is  Overabundant;  5  is  Few) 
Comments: 

3.  Individual  Average  Score 


(1C  +  2B  +  2D)/3: 


48 


20 


41.7% 


60% 


20% 


40.6% 


45 


CADET  TRAINING/RESEARCH  PRACTICAL 
EXERCISES  EVALUATION  FORM 


CADET:  SUBJECT  3 


SIMULATOR  GROUP  Experienced  or 


Inexperienced 


Evaluators  —  Visual:  CMDR.  MEURN 
Radar:  W.  MILLER 


1.  Evaluation  form 

A  Highest  Possible  Score: 

B  Total  Score 

C  Percentage  B/A 

2  Physical  Measurements 

A.  Radar  Fixes  (Scale  1  to  5): 

B  Percentage  A/5: 

(1  is  Poor;  5  is  Excellent) 
Comments: 

C  Helm  Orders  — 

Course  Recorder 
(Scale  1  to  5): 

D  Percentage  C/5: 

(1  is  Overabundant;  5  is  Few) 
Comments: 


3.  Individual  Average  Score 


CADET  TRAINING/RESEARCH  PRACTICAL 
EXERCISES  EVALUATION  FORM 


CADET  SUBJECT 4 


SIMULATOR  GROUP  Experienced  or  [  Inexperienced 
Evaluators  —  Visual:  CMDR  MEURN 
Radar  W.  MILLER 


1  Evaluation  form 

A  Highest  Possible  Score: 

B  Total  Score: 

C  Percentage  B/A 

2  Physical  Measurements 

A  Radar  Fixes  (Scale  1  to  5): 

B  Percentage  A/5: 

(1  is  Poor,  5  is  Excellent) 
Comments: 

C  Helm  Orders  — 

Course  Recorder 
(Scale  1  to  5): 

D  Percentage  C/5: 

(1  is  Overabundant;  5  Is  Few) 
Comments 

3  Individual  Average  Score 


48 


19.5 


40.6% 


3 


60% 


3 _ 

60% 


(1C  +  2B  ♦  2D)/3 


53.5% 


47 


CADET  TRAINING/RESEARCH  PRACTICAL 
EXERCISES  EVALUATION  FORM 


CADET 


SUBJECT  5 


SIMULATOR  GROUP  Experienced  or 


Inexperienced 


Evaluators  Visual  CMDR  MEURN 


Radar  W  MILLER 


1  Evaluation  form 

A  Highest  Possible  Score: 

B  Total  Score: 

C.  Percentage  B/A 

2  Physical  Measurements 

A  Radar  Fixes  (Scale  1  to  5): 

B  Percentage  A/5. 

(1  is  Poor;  5  is  Excellent) 
Comments: 

C.  Helm  Orders  — 

Course  Recorder 
(Scale  1  to  5): 

0  Percentage  C/5: 

(1  is  Overabundant:  5  is  Few) 
Comments: 


48 

9 

18  7% 


0% 


ABORTED  THE  RUN-NEVER  UNDERSTOOD  THE 
_ _ PURPOSE  OF  A  RANGE 


1 

20% 


3  Individual  Average  Score 


CADET  TRAINING/RESEARCH  PRACTICAL 
EXERCISES  EVALUATION  FORM 


CAUL  I 


SUBJECT  6 


SIMULATOR  GROUP  Experienced  or 


Inexperienced 


E  valuators  Visual  CMDR  MEURN 


Radar  W  MILLER 


1  Evaluation  form 

A  Highest  Possible  Score: 

B  Total  Score 
0  Percentage  B/A 
^  Physical  Measurements 

A  Radar  Eixes  (Scale  t  to  5) 

Ei  Percentage  A/5 

(1  is  Poor,  5  is  Excellent) 
Comments 
C  Helm  Orders 
Course  Ree.orrler 
(Scale  1  to  5) 

0  Percentage  C/5 

it  is  Overabundant,  5  is  Few) 
Comments 


i  Individual  Average  Score 


